IE-Net: Information-Enhanced Binary Neural Networks for Accurate Classification

نویسندگان

چکیده

Binary neural networks (BNNs) have been proposed to reduce the heavy memory and computation burdens in deep networks. However, binarized weights activations BNNs cause huge information loss, which leads a severe accuracy decrease, hinders real-world applications of BNNs. To solve this problem, paper, we propose information-enhanced network (IE-Net) improve performance Firstly, design an binary convolution (IE-BC), enriches boosts representational power convolution. Secondly, estimator (IEE) gradually approximate sign function, not only reduces loss caused by quantization error, but also retains weights. Furthermore, reducing representations, novel gain large compared with previous work. The experimental results show that IE-Net achieves accuracies 88.5% (ResNet-20) 61.4% (ResNet-18) on CIFAR-10 ImageNet datasets respectively, outperforms other SOTA methods. In conclusion, could be improved significantly enhancement both activations.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks

We propose two efficient approximations to standard convolutional neural networks: Binary-Weight-Networks and XNOR-Networks. In Binary-WeightNetworks, the filters are approximated with binary values resulting in 32× memory saving. In XNOR-Networks, both the filters and the input to convolutional layers are binary. XNOR-Networks approximate convolutions using primarily binary operations. This re...

متن کامل

Understanding the Loss Surface of Neural Networks for Binary Classification

It is widely conjectured that the reason that training algorithms for neural networks are successful because all local minima lead to similar performance; for example, see [1, 2, 3]. Performance is typically measured in terms of two metrics: training performance and generalization performance. Here we focus on the training performance of neural networks for binary classification, and provide co...

متن کامل

Ensemble of Duo Output Neural Networks For Binary Classification

This paper presents an ensemble of duo output neural networks (DONN) using bagging technique to solve binary classification problems. DONN is a neural network that is trained to predict a pair of complementary outputs which are the truth and falsity values. Each component in an ensemble contains two DONNs in which the first network is trained to predict the truth and falsity outputs whereas the...

متن کامل

Binary classification using ensemble neural networks and interval neutrosophic sets

This paper presents an ensemble neural network and interval neutrosophic sets approach to the problem of binary classification. A bagging technique is applied to an ensemble of pairs of neural networks created to predict degree of truth membership, indeterminacy membership, and false membership values in the interval neutrosophic sets. In our approach, the error and vagueness are quantified in ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Electronics

سال: 2022

ISSN: ['2079-9292']

DOI: https://doi.org/10.3390/electronics11060937